Check a prototype of 2nd version of this platform
being developed by cKnowledge.org in collaboration with
MLCommons.
list_experiments mlperf
ck-action:list_experiments mlperf (v3.0.0)
License: BSD 3-clause (code) and CC BY-SA 4.0 (data)
Creation date: 2019-03-12
Source: GitHub
cID: 081173242a88bc94:2c00d872423990ec
Don't hesitate to get in touch if you encounter any issues or would like to discuss this community project!
Creation date: 2019-03-12
Source: GitHub
cID: 081173242a88bc94:2c00d872423990ec
Description
- Automation framework: CK
- Workflow: MLPerf benchmarking - common functionality
- Development repository: ck-ml
- Source: GitHub
- How to get the stable version via the CK client:
pip install cbench
cb download module:mlperf --version=3.0.0 --all
ck list_experiments mlperf --help - How to get the development version:
pip install ck
ck pull repo:ck-ml
ck list_experiments mlperf --help
- How to run from Python:
import ck.kernel as ck
r=ck.access({'action':'',
'module_uoa':'',
... See JSON API below ...
})
if r['return']>0: return r
...
- Module description: Validate MLPerf submission against reference
- API Python code: Link
- JSON API:
" Input: { (repo_uoa) - experiment repository name ('*' by default) (extra_tags) - extra tags to filter (add_meta) - request to return metadata with each experiment entry } Output: { return - return code = 0, if successful > 0, if error (error) - error text if return > 0 } "